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DETAILED ACTION 

Election/Restrictions 

1 . Applicant's election of claims 39-62 in the reply filed on October 8, 2004 is 
acknowledged. Because applicant did not distinctly and specifically point out the 
supposed errors in the restriction requirement, the election has been treated as an 
election without traverse (MPEP § 818.03(a)). 

Specification 

2. The disclosure is objected to because of the following informalities: 

a. Page 13, line 6: change "202" to -187--. 

b. Page 18, line 13: change "222" to -254-. 

c. Page 28, line 14: change "Oc" to - Oo-. 
Appropriate correction is required. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 
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4. Claims 39-52 and 58 are rejected under 35 U.S.C. 102(e) as being anticipated by 

Chen (U.S. Patent 6,552,744). 

Regarding claim 39, Chen discloses a method of rendering a view of a 
surrounding scene, the method comprising: determining, for the view to be 
rendered, a viewing position representing a location of an observer that is 
observing the surrounding scene (col. 2, lines 52-57); and for each pixel in an 
image to be rendered as a representation of the view of the surrounding scene, 
determining a viewing ray (observer's line of sight) passing through the pixel in 
the direction of viewing the observer, and selecting which of a plurality of 
longitudinally adjacent capture images is to be used to determine a display value 
for the pixel (The 0/P sensor (21) will determine the observer's orientation, which 
would include the observer's line of sight. Furthermore, the observer's position 
along with the observer's orientation will determine which of the plurality of 
longitudinally adjacent capture images will be used to determine the display) (col. 
3, lines 44-53). 

Regarding claim 40, Chen discloses all the limitations as previously 
discussed with respect to claim 39 as well as disclosing a method wherein the 
surrounding scene is defined by a capture cylinder (37) including a plurality of 
longitudinal image arrays generated from a plurality of capture images (Fig. 2; 
col. 5, lines 20-24; col. 5, line 60 - col. 6, line 5). 

Regarding claim 41, Chen discloses all the limitations as previously 
discussed with respect to claims 39 and 40 as well as disclosing the method 
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further comprises; determining an intersection point between the viewing ray 
(observer's line of sight) and the capture cylinder (37); and using the intersection 
point to determine which one or more of the plurality of longitudinal image arrays 
to use to determine the display value for the pixel (col. 3, lines 44-53; col. 5, line 
60 - col. 6, line 5; col. 7, line 65 - col. 8, line 3; The intersection point will be 
determined by the 0/P sensor (21) with respect to the capture cylinder (37)). 

Regarding claim 42, Chen discloses all the limitations as previously 
discussed with respect to claims 39-41 as well as disclosing the method further 
comprises Interpolating, based on the plurality of longitudinal image arrays, to 
determine the display value for the pixel if more than one of the plurality of image 
arrays is used (col. 7, line 65 - col. 8, line 3; zooming is mentioned as one of the 
movements that changes the position of the display and when the image is 
zoomed in on it is inherent that interpolation is used to create the image on the 
display and to determine the display values). 

Regarding claim 43, Chen discloses all the limitations as previously 
discussed with respect to claims 39-41 as well as disclosing a method wherein 
the selecting further comprises determining, based on the intersection point, 
which one or more of a plurality of image columns in each of the one or more of 
the plurality of longitudinal image arrays to use to determine the display value for 
the pixel (col. 7, line 65 - col. 8, line 3; zooming is mentioned as one of the 
movements that changes the position of the display and when the image is 
zoomed in on it is inherent that interpolation, which would include selecting 
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certain image columns based on the intersection point, is used to create the 
image on the display and to determine the display values). 

Regarding claim 44, Chen discloses all the limitations as previously 
discussed with respect to claims 39-41 and 43 as well as disclosing the method 
further comprising interpolating, based on the plurality of image columns, to 
determine the display value for the pixel if more than one of the plurality of image 
columns is used (col. 7, line 65 - col. 8, line 3; zooming is mentioned as one of 
the movements that changes the position of the display and when the image is 
zoomed in on it is inherent that interpolation is used to create the image on the 
display and to determine the display values). 

Regarding claim 45, Chen discloses all the limitations as previously 
discussed with respect to claims 39-41 and 43 as well as disclosing a method 
wherein determining which one or more of the plurality of image columns to use 
comprises: calculating an angle between the viewing ray (observer's line of sight) 
and a camera direction at the intersection point; and identifying the one or more 
of the plurality of image columns based on the calculated angle (The 0/P sensor 
(21) will determine the observer's orientation, which would include the observer's 
line of sight. Furthermore, the observer's position along with the observer's 
orientation will determine which of the plurality of image columns are to be used. 
It is inherent that Chen uses the angle between the viewing ray and the camera 
position is determined in order to show the correct portion of the scene that the 
observer is viewing.). 
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Regarding claim 46, Chen discloses all the limitations as previously 
discussed with respect to claims 39-41 and 43 as well as disclosing a method 
wherein the selecting further comprises determining, based on an elevation angle 
of the viewing ray, which one or more longitudinally adjacent capture images to 
use to determine the display value for the pixel (The 0/P sensor (21 ) will 
determine the observer's orientation, which would include the observer's line of 
sight. Furthermore, the observer's position along with the observer's orientation 
will determine which one or more longitudinally adjacent capture images are to 
be used to determine the display value for the pixel. It is inherent that the 
elevation angle would be determined to correctly display the scene the observer 
is looking at since one of the movements the observer is allowed to make is up 
and down (col. 7, line 65 - col. 8, line 3)), 

Regarding claim 47, Chen discloses all the limitations as previously 
discussed with respect to claims 39-41 , 43, and 46 as well as disclosing a 
method wherein the selecting further comprises determining, based on the 
elevation angle of the viewing ray, which one or more pixels from the one or 
more capture images to use to determine the display value for the pixel (The 0/P 
sensor (21 ) will determine the observer's orientation, which would include the 
observer's line of sight. Furthermore, the observer's position along with the 
observer's orientation will determine which of the plurality of image columns. It is 
inherent that the elevation angle would be determined to correctly display the 
scene the observer is looking out since one of the movements the observer is 
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allowed to make is up and down (col. 7, line 65 - col. 8, line 3). Also determining 
which pixels to be used to determine the display value for the pixel to be display 
would be included as well since zooming is another option the observer is 
allowed to do and when the image is zoomed in on it is inherent that 
interpolation, which would include selecting one or more pixels from the captured 
images to be used to create the image on the display and to determine the 
display values). 

Regarding claim 48, Chen discloses all the limitations as previously 
discussed with respect to claim 39 as well as disclosing the method further 
comprises rendering a new view of the surrounding scene in response to 
movement of the observer in one or more of two dimensions (col. 3, lines 44-53; 
col. 7, line 65- col. 8, line 3). 

Regarding claim 49, Chen discloses all the limitations as previously 
discussed with respect to claim 39 as well as disclosing the method further 
comprises rendering a new view of the surrounding scene in response to 
movement of the observer in one or more of three dimensions (col. 3, lines 44- 
53; col. 7, line 65 - col. 8, line 3). 

Regarding claim 50, Chen discloses all the limitations as previously 
discussed with respect to claims 39 and 49 as well as disclosing a method 
wherein the surrounding scene is defined by a capture cylinder (37) generated 
from a plurality of capture images (Fig. 2; col. 5, lines 20-24; col. 5, line 60 - col. 
6, line 5), and wherein the observer is able to move within the capture cylinder 
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(37) but is constrained such that the field of view of the observer does not exceed 
the capture cylinder (37) (col. 7, line 65 - col. 8, line 3; the statement "to allow 
the user to select which portion of a panoramic image" to view implies that the 
user is constrained within the capture cylinder (37)). 

Regarding clainn 51, Chen discloses all the limitations as previously 
discussed with respect to claim 39 as well as disclosing a method wherein the 
surrounding scene is defined by a capture images, and wherein the observer is 
able to move within the capture cylinder (37) but is constrained from moving 
outside the capture cylinder (37) (col. 7, line 65 - col. 8, line 3; the statement "to 
allow the user to select which portion of a panoramic image" to view implies that 
the user is constrained within the capture cylinder (37)). 

Regarding claim 52, Chen discloses all the limitations as previously 
discussed with respect to claim 39 as well as disclosing a method wherein the 
surrounding scene is defined by a capture cylinder (37) generated from a plurality 
of capture images, and wherein the observer is able to move within the capture 
cylinder (37) but is constrained from moving outside either the capture cylinder 
(37) or a circle that is substantially parallel to the ends of the cylinder (col. 7, line 
65 - col. 8, line 3; the statement "to allow the user to select which portion of a 
panoramic image" to view implies that the user is constrained within the capture 
cylinder (37)). 

Regarding claim 58, Chen discloses one or more computer-readable 
memories containing a computer program (24) that is executable by a processor 
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(19) to perform the method of rendering a view of a surrounding scene, the 
method comprising: determining, for the view to be rendered, a viewing position 
representing a location of an observer that is observing the surrounding scene 
(col. 2, lines 52-57); and for each pixel in an image to be rendered as a 
representation of the view of the surrounding scene, determining a viewing ray 
(line of sight) passing through the pixel in the direction of viewing the observer, 
and selecting which of a plurality of longitudinally adjacent capture images is to 
be used to determine a display value for the pixel (The 0/P sensor (21) will 
determine the observer's orientation, which would include the observer's line of 
sight. Furthermore, the observer's position along with the observer's orientation 
will determine which of the plurality of longitudinally adjacent capture images will 
be used to determine the display) (col. 3, lines 44-53). 

5. Claims 39, 53-57, and 59-62 are rejected under 35 U.S.C. 102(e) as being 

anticipated by Chen (U.S. Patent 6,552,744). 

Regarding claim 39, Chen discloses a method of rendering a view of a 
surrounding scene, the method comprising: determining, for the view to be 
rendered, a viewing position representing a location of an observer that is 
observing the surrounding scene (col. 8, lines 61 - col. 9, line 5); and for each 
pixel in an image to be rendered as a representation of the view of the 
surrounding scene, determining a viewing ray (observer's line of sight) passing 
through the pixel in the direction of viewing the observer, and selecting which of a 
plurality of longitudinally adjacent capture images is to be used to determine a 
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display value for the pixel (The 0/P sensor (21) will determine the observer's 
orientation, which would include the observer's line of sight. Furthermore, the 
observer's position along with the observer's orientation will determine which of 
the plurality of longitudinally adjacent capture images will be used to determine 
the display) (col. 3, lines 44-53). 

Regarding claim 53, Chen discloses all the limitations as previously 
discussed with respect to claim 39 as well as disclosing the method further 
comprises concurrently rendering another view of the surrounding scene, 
wherein the rendered view corresponds to a viewing position of one eye of an 
eye pair and the other rendered view corresponds to a viewing position of 
another eye of the eye pair (col. 8, lines 61 - col. 9, line 5). 

Regarding claim 54, Chen discloses all the limitations as previously 
discussed with respect to claims 39 and 53 as well as disclosing the method 
further comprises rendering a new view for each eye of the eye pair in response 
to movement of the eye pair in one or more of three dimensions (col. 8, lines 61 - 
col. 9, line 5; col. 7, line 65 - col. 8, line 3). 

Regarding claim 55, Chen discloses all the limitations as previously 
discussed with respect to claims 39 and 53 as well as disclosing the method 
further comprises using a two-body rigid object model to describe motion of the 
eye pair (It is inherent that the method uses a two-body rigid object mode to 
describe motion of the eye pair since two different viewing angles are being used 
(col. 8, lines 61-67). 
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Regarding claim 56, Chen discloses all the limitations as previously 
discussed with respect to claims 39 and 53 as well as disclosing a method 
wherein the surrounding scene is defined by a capture cylinder (37) generated 
from a plurality of capture images, and wherein the eye pair is able to move 
within the capture cylinder (37) but is constrained such that neither eye of the eye 
pair can move outside the capture cylinder (37) (Fig. 2; col. 5, lines 20-24; col. 5, 
line 60 - col. 6, line 5), and wherein the observer is able to move within the 
capture cylinder (37) but is constrained such that the field of view of the observer 
does not exceed the capture cylinder (37) (col. 7, line 65 - col. 8, line 3; the 
statement "to allow the user to select which portion of a panoramic image" to 
view implies that the user is constrained within the capture cylinder (37)). 

Regarding claim 57, Chen discloses all the limitations as previously 
discussed with respect to claims 39 and 53 as well as disclosing a method 
wherein the surrounding scene is defined by a capture cylinder (37) generated 
from a plurality of capture images, and wherein the eye pair is able to move 
within the capture cylinder (37) but is constrained such that neither eye of the eye 
pair can move outside either the capture cylinder (37) or a circle that is 
substantially parallel to the ends of the cylinder (col. 7, line 65 - col. 8, line 3; the 
statement "to allow the user to select which portion of a panoramic image" to 
view implies that the user is constrained within the capture cylinder (37)). 

Regarding claim 59, Chen discloses one or more computer-readable 
media having stored thereon a computer program (24) that, when executed by 
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one or more processors (19) of a computer, causes the one or more processors 
(19) to perform acts including: determining, for a view of the surrounding scene to 
be rendered, a viewing position representing a location of a point of view inside 
the scene (col. 8, line 61 - col. 9, line 5), wherein the surrounding scene is 
defined by a capture cylinder (37) including a plurality of longitudinal image 
arrays generated from a plurality of capture images (Fig. 2; col. 5, lines 20-24; 
col. 5, line 60 - col. 6, line 5); and for each pixel in an image to be rendered as a 
representation of the view of the surrounding scene, determining a viewing ray 
passing (observer's line of sight) through the pixel in a direction of viewing 
corresponding to the view, determining an intersection point between the viewing 
ray and the capture cylinder (37) (The 0/P sensor (21 ) will determine the 
observer's orientation, which would include the observer's line of sight. 
Furthermore, the observer's position along with the observer's orientation will 
determine which of the plurality of longitudinally adjacent capture images will be 
used to determine the display) (col. 3, lines 44-53), using the intersection point to 
determine which one or more of the plurality of longitudinal image arrays to use 
to determine the display value for the pixel (col. 3, lines 44-53; col. 5, line 60 - 
col, 6, line 5; col. 7, line 65 - col. 8, line 3; The intersection point will be 
determined by the 0/P sensor (21 ) with respect to the capture cylinder (37)); 
determining, based on the intersection point, which one or more of a plurality of 
image columns in each one of the more of the plurality of longitudinal image 
arrays to use to determine the display value for the pixel (col. 7, line 65 - col, 8, 
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line 3; zoonning is nnentioned as one of the nnovements that changes the position 
of the display and when the innage is zoonned in on it is inherent that 
interpolation, which would include selecting certain innage columns based on the 
intersection point, is used to create the image on the display and to determine 
the display values); determining, based on the elevation angle of the viewing ray, 
which one or more longitudinally adjacent capture images corresponding to the 
one or more longitudinally image arrays to use to determine the display value for 
the pixel (col. 7, line 65 - col. 8, line 3; zooming is mentioned as one of the 
movements that changes the position of the display and when the image is 
zoomed In on it is inherent that interpolation is used to create the image on the 
display and to determine the display values).; determining, based on the 
elevation angle of the viewing ray, which one or more pixels from the one or 
more longitudinally adjacent capture images from the one or more capture 
images to use to determine the display value for the pixel(The 0/P sensor (21 ) 
will determine the observer's orientation, which would include the observer's line 
of sight. Furthermore, the observer's position along with the observer's 
orientation will determine which one or more longitudinally image arrays are to be 
used to determine the display value for the pixel. It is inherent that the elevation 
angle would be determined to correctly display the scene the observer is looking 
at since one of the movements the observer is allowed to make is up and down 
(col. 7, line 65 - col, 8, line 3)); and determining the display value for the pixel 
based on the display values of each of the one or more pixels (The 0/P sensor 
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(21) will determine the observer's orientation, which would include the observer's 
line of sight. Furthermore, the observer's position along with the observer's 
orientation will determine which of the plurality of image columns. It is inherent 
that the elevation angle would be determined to correctly display the scene the 
observer is looking out since one of the movements the observer is allowed to 
make is up and down (col. 7, line 65 - col. 8, line 3). Also determining which 
pixels to be used to determine the display value for the pixel to be display would 
be included as well since zooming is another option the observer is allowed to do 
and when the image is zoomed in on it is inherent that interpolation, which would 
include selecting one or more pixels from the captured images to be used to 
create the image on the display and to determine the display values). 

Regarding claim 60, Chen discloses all the limitations as previously 
discussed with respect to claim 59 as well as disclosing one or more computer- 
readable media wherein the surrounding scene is defined by a capture cylinder 
(37) generated from a plurality of capture images, and wherein the observer is 
able to move within the capture cylinder (37) but is constrained from moving 
outside the capture cylinder (37) (col. 7, line 65 - col. 8, line 3; the statement "to 
allow the user to select which portion of a panoramic image" to view implies that 
the user is constrained within the capture cylinder (37)). 

Regarding claim 61, Chen discloses all the limitations as previously 
discussed with respect to claim 59 as well as disclosing one or more computer- 
readable media wherein the surrounding scene is defined by a capture cylinder 
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(37) generated from a plurality of capture images, and wherein the observer is 
able to move within the capture cylinder (37) but is constrained from moving 
outside either the capture cylinder (37) or a circle that is substantially parallel to 
the ends of the cylinder (col. 7, line 65 - col. 8, line 3; the statement "to allow the 
user to select which portion of a panoramic image" to view implies that the user is 
constrained within the capture cylinder (37)). 

Regarding claim 62, Chen discloses all the limitations as previously 
discussed with respect to claim 59 as well as disclosing one or more computer- 
readable media further comprise concurrently rendering another view of the 
surrounding scene, wherein the rendered view corresponds to a viewing position 
of one eye of an eye pair and the other rendered view corresponds to a viewing 
position of another eye of the eye pair (col. 8, line 61 - col. 9, line 5). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Heather R Long whose telephone number is 703-305- 
0681 . The examiner can normally be reached on Mon. - Thurs.: 7:00 am - 4:30 pm, and 
every other Fri.: 7:00 am - 3:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
acting supervisor, Thai Tran can be reached on (703) 305-4725. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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